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Abstract 

We analyze fermion mass-matrix structure in an asymptotically non-free 
model with 4-1-1 generations. The texture at the GUT scale is uniquely deter- 
mined by supposing that the masses of heavy up-type quarks (charm as well 
as top) are realized as their infrared fixed point values. By assuming 5*0(10) 
GUT-like relations for Yukawa couplings in this model, this texture can ex- 
plain all fermion masses and quark mixing with only one small parameter, 
which is almost equal to the Cabibbo angle. 
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1 Introduction 



Determining the origin of fermion masses and mixing is one of the most important 
problems in constructing matter unification models. In the framework of the minimal 
supersymmetric standard model (MSSM), which is successful in attaining gauge 
coupling unification there are many works dedicated obtaining fermion mass 
structure 0. One interesting feature which has been found is that the MSSM with 
the S'f/(5)-GUT relation is almost consistent with the observed bottom-tau mass 
ratio 0. 

In previous papers @, we investigated an extension of the MSSM with an 
asymptotically non-free (ANF) property motivated by the possibility of dynamical 
gauge bosons. The difference between dynamical gauge bosons and elementary gauge 
bosons is the existence of the compositeness condition at some scale below which 
they behave as if they are asymptotically non-free gauge fields [0. It is interesting 
to determine whether or not the present standard gauge theory with ANF character 
preserves the above good predictions of the MSSM. As an example we consider the 
simplest case in which there are 2 extra generations, forming a generation-mirror 
generation pair (the 4th and anti-4th generations) with SU{2)w x U{1)y invariant 
Dirac masses M. There are many works that address the idea of extra fermions, 
especially vector-like families, which are motivated by various physical backgrounds, 
string models |]^, composite models [Q, grand unified models 0, etc., and the pos- 
sibility of having new families just above the 3-generation families is interesting. 
This vector-like matter is compatible with the constraints determined by the LEP 
measurements, namely the so-called Peskin-Takeuchi constraints |]IU|. Following 
Babu and Pati in Ref. [§, we call this the extended supersymmetric standard model 
(ESSM) hereafter. In the ESSM three gauge couplings are also unified at almost the 
same scale as that of the MSSM but with different unified coupling. An immediate 
consequence of the ESSM is that all three gauge couplings of SU{3)c, SU{2)w and 
U{1)y, are ANF: they become larger as they evolve up to coincide at the unifica- 
tion scale. This model is a typical one in which the asymptotically non-free gauge 
couplings remain reasonably small up to the GUT scale (see Ref. and references 
therein) and the model is worth investigating. 

Another interesting feature of the ESSM is the infrared fixed-point structure of 
Yukawa couplings due to the ANF gauge couplings. In Ref. [Q, we pointed out that 
the top and bottom quark masses are reproduced as infrared fixed point (IRFP) 
predictions, which are almost insensitive to initial GUT conditions due to the ANF 
characters of gauge couplings. Such strong convergence of Yukawa couphngs to their 
infrared fixed points is a common feature appearing in ANF theories |12|. In such 
a case, the IRFP structure acts to translate symmetry structures into quantitative 
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predictions for low-energy physical parameters, as stressed in Ref. ||T3[. We demon- 
strated how strongly the couplings are focused into their infrared fixed points in ANF 
theories as well as the structure of the renormalization-group flows by comparing 
the ESSM with the MSSM §. 

In the above mentioned analyses, we neglected the small Yukawa couplings of the 
first and second generations. However, the existence of Yukawa couplings to the 4th 
and 4th generations may affect their structure in some way. In this paper we study 
the fermion masses of 5 full generations. As is well known, the ordinary fermion 
masses show typical hierarchical structures with small parameters ~ 0(10"'-^^^''), 
which have to be introduced from the beginning in GUT textures. In the ESSM 
case we have one more hierarchical factor; the ratio of the usual SU{2)w x U{1)y 
breaking mass m and the invariant mass M (m -C M). By making full use of the 
infrared fixed point structure and the hierarchical ratio m/M, we shall determine 
their textures at the GUT scale. 

In section 2 we give a quick summary of the present status of the fermion masses 
and mixing and of some features of our previous analysis in the ESSM. In section 3 
we analyse the simplest case in which the invariant mass appears only in the 4th and 
4th fermions. It is found that the texture at the GUT scale is uniquely determined 
if we impose the condition that the masses of heavy up-type quarks are realized 
as their infrared fixed point values, together with SO{10) GUT-like relations for 
Yukawa couplings. We will see that this texture reproduces the fermion masses and 
quark mixing by introducing only one small parameter e ~ 0.2, which is almost 
equal to the Cabibbo angle. Concluding remarks and comments are made in section 
4. Appendix A is devoted to more complicated analysis in which more invariant 
masses M are included or texture is non-symmetric. We find that none of them can 
reproduce the present experimental data of masses and mixing. The renormalization 
group equations in the ESSM are given in Appendix B. 



2 Fermion masses and mixing 
2.1 Issues of fermion mass 

The possible sources which determine fermion masses are as follows. 



1. The texture of Yukawa matrix at the GUT scale [Q: The GUT relations 
of Yukawa couplings are important to account for the hierarchical structure 
between generations. Although no rational basis is known to determine the 
intergenerational relationship, fermion masses seem to exhibit typical hierar- 
chical structures. This may indicate the existence of a kind of generation quan- 
tum numbers. Actually there are many papers to explain hierarchical Yukawa 
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couplings by assuming horizontal symmetry |jT5|, using anomalous U{1) |[16| , 
etc., where we can make an active use of higher dimensional operators which 
effectively give very small Yukawa couplings. In any case it is important to 
determine the texture of the Yukawa matrix at the GUT scale according to 
some yet unknown rule. We shall determine the texture phenomenologically 
assuming that some unknown mechanism yields hierarchical structure. 

2. Running couplings from the GUT scale to weak scale: Once we fix the texture 
at GUT scale the renormalization group equations (RGE) tell us the resultant 
Yukawa couplings at low-energy scale. Since the Yukawa couplings, except 
for those of third generation, are much smaller than the strength of gauge 
couplings (especially the QCD coupling), usually the renormalization effect 
comes mainly from QCD. The relative ratio between quark Yukawa couplings 
is not largely changed by RGE. The only important factor is the ratio of 
Yukawa couplings of quarks and leptons. 

3. Mixing pattern of light Higgses: For the moment we treat the Higgs potential, 
and Higgs mixing (including tan/3), as free parameters to be determined phe- 
nomenologically, since we always encounter the well-known fine-tuning prob- 
lem. 



For later convenience, we list the masses of the present existing fermions at Mz scale 
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m„ ~ 2.33toil MeV, 

~ 677^11 MeV, 
mt ~ 181 ± 13 GeV, 



4.69t°-^° MeV, 



rris ~ 

nib ~ 3.00 ±0.11 GeV, 



-0.66 

93.41}^:^ MeV, 



rrir 



0.486847 MeV, 
102.75 MeV, 
1.7467 GeV. 



(2.1) 



2.2 Mixing angles 



The observed values for the CKM matrix elements are 18 



\V( 



CKM I 



0.9745 - 0.9757 0.219- 0.224 0.002 - 0.005 
0.218 - 0.224 0.9736- 0.9750 0.036 - 0.046 
0.004- 0.014 0.034- 0.046 0.9989 - 0.9993, 



(2.2) 



These data also indicate hierarchical structure: 



9i2 ~ sin^c = A ~ 0.22, 



723 



713 



,T ~ A 



3-4 



(2.3) 



It is interesting to note the following relations between the mixing angles and the 
relevant mass eigenvalues (at Mz scale): 



3 



712 



0.22 



\]mu/mc = 0.051 ~ 0.067, ^/mjm's = 0.196 ~ 0.256, 



(2.4) 



~ 0.003 



\frrijmt 



0.003 ~ 0.004, 



0.036 ~ 0.043, 



(2.5) 



023 ~ 0.037 



nic/nit = 0.056 ~ 0.066, Jms/nib = 0.161 ~ 0.191, (2.6) 



where the mixing angles may be related to the ratios of the mass eigenvalues by 
taking the following down and up pO| side mass matrices via the seesaw mech- 
anism: 



m 



(12) 
D 



and 



m 



(13) 




(2.7) 



rrif 



(2.8) 



However, the 2-3 mixing is too small compared with the mass ratio in either the 
up or down sector. We need a more complicated mechanism which may be the 
combination of mixing in both up and down sectors. 



2.3 Fermion masses of third generation in ESSM 

Before proceeding to the analysis of the full fermion masses in the ESSM we make 
a quick review of our previous results for the third generation fermion masses. 

The characteristic features of the ESSM are that, due to the ANF character, 
the Yukawa couplings approach their infrared fixed points very rapidly and that the 
RGE effect of QCD on the quark enhances down to charged lepton mass ratio by 
a factor of approximately 5 — 6. This is much more than in the MSSM case, in 
which this factor is ~ 3. One might think that this QCD enhancement will make 
it impossible to bring the low-energy bottom-tau mass ratio Rb/riMz) down to 
the experimental value (1.6 ~ 1.8) even with large Yukawa couplings (large tan/3). 
However, if we adopt the unification condition of an 50(10) GUT with a 126-Higgs, 
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the extra enhancement from QCD is actually welcome, since Rh/r must be enhanced 
by a factor of 5 — 6 to reproduce the experimental value of Rb/n 

YtiMcvT) = ^(Mgut) = ^K(Mgut) ^ Rb/AMz) ~ (2.9) 

Another remarkable result is that due to the ANF gauge couplings, the top 
and bottom Yukawa couplings are determined almost independently of their initial 
values fixed at GUT scale. Indeed these Yukawa couplings reach to their fixed 
points, which are physically significant and provide us with reliable predictions of 
low-energy parameters. By using these fixed-point solutions and the experimental 
value of Q;3(lTeV) ~ 0.093, we get, for example,^] 

mt{Mz) ~ 178 GeV, nibiMz) ~ 3.2 GeV. (2.10) 
(tan/5 ~ 58) 

These values are certainly consistent with the experimental values WE . 



3 Mass texture and IR fixed points 

We consider the following extended supersymmetric standard model with 5 genera- 
tions, the MSSM (3 generations) + 1 extra vector-like family (4 + 4). The matter 
content of this model is 

Qi, Ui, di, Li, Ci, (2 = 1, ■■■,4) (3.1) 

Q,u,d,L,e, (z = 4) (3.2) 

H,H,^. (3.3) 

In addition to H and H, which form a pair of SU {2)w doublet Higgs fields, we have 
$, a (standard gauge group) singlet Higgs which yields masses of the extra vector- 
like family. In this paper, we consider one $, which attains a vacuum expectation 
value on the order of the TeV scale 0-||rT|, by taking suitably soft SUSY breaking 
terms of $. In this situation, the superpotential becomes 



i,j=l,-A 

+ Y^QauH'' + Y^QadH'' + Y.LaeH'' + Y^' 
+ Yl {YQ^<^QtQa + Y^^<l>u,u + Y,^<l>d,d + YL^<l>L'lLa + Y,^<l>e,e) (3.4) 

i=l,---,4 



*The tau-lepton Yukawa coupling generally has no infrared fixed-point solution since it does 
not have a strong SU (3) interaction. We then treat it as an input parameter and determine the 
value of tan/9 from the experimental value for mT-{Mz). 
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where the subscripts i,j and a, b are indices of generation and SU {2)w, respectively, 
and other indices are trivially contracted. With this superpotential, after SU{2)w x 
U{1)y breaking, the forms of the 5x5 fermion mass matrices can be written as 



UlR 



U4R UlR 



mu 



mo = 



rriE 



U4L 

diL 



d 



IR 



em 



eiL 

Gal 



YuVd j 
diR diR 

\ 



e-m egR 



\ 

YgVu J 



(3.5) 



(3.6) 



(3.7) 



Vd 







(3.8) 



where UiL,diL,eiL, (uir)'-^ , {dgR)'-^ and {egR)'-^ are fermionic components of SU{2)w 
doublet fields, and (uiR)'^, (diR)'^, (cji?)*^, x^iL, c?4l and en are those of SU{2)w sin- 
glets. 



3.1 Candidate for texture and IR fixed points 

Before discussing realistic texture, we classify the types of texture which yield hier- 
archical masses, referring to their infrared behavior. Since we know that the usual 
quark and lepton mass matrices exhibit generally typical hierarchical structures, we 
first consider the dominant part of the matrices including only the 3rd, 4th and 4th 
generations and then include less important contributions step-by-step. Hereafter, 
for simplicity m,rh and M are used symbolically to represent Yf^^Vu^d ,YjVu,d and 
Yf^V {f = u.d,e), respectively, since in our classification only the order of their 
masses are important (m <^ M). For the moment, let us restrict ourselves to the 
situation in which Yukawa couplings, Yf^., are symmetric (at the GUT scale) and 
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only the 4th generation couples to the 4th generation forming an invariant mass 
term M . Analyses for general situations are performed in Appendix A. 

First let us consider the dominant matrices (for the 3rd, 4th and 4th generations). 
For m -C M, after diagonalization at low energy, two of the three eigenvalues are 
on the order of M, and one eigenvalue 777.33 is small compared with M. In order 
to get non-zero 77733, there are three candidates for the textures classified by their 
determinants: 

• case 1 



case 2 



• case 3 



3 

4 
4 



3 

/ 777 



M 



4 

0\ 

M 

I 



det 



3x3 



M^777 



(3.9) 



77733 ~ ?77. 



(3.10) 







3 


4 


4 


3 


/ 





777 


o\ 


4 




m 




M 


4 


\ 





M 


in J 



det 



3x3 ~ ?77 777 



(3.11) 



mm \ 



(3.12) 



3 

3/0 



4 
4 



777 




4 4 

777 \ 

777 M 

M J 



det3xj 



(3.13) 



77733 ~ (radiatively induced). 



(3.14) 



Here and hereafter, if an element is it is implied that it should be exactly zero at 
the GUT scale. A blank entry corresponds to the case in which it can be either zero 
or nonzero. For the case 3, the determinant of this texture is zero. However, this 
type of matrix induces an appreciable non-zero 133 element via the renormalization 
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group, and the resultant low-energy determinant (and eigenvalue m^s) cannot be 
neglected. 

Next, we include the second generation and consider 4x4 matrices. In order 
to obtain hierarchical mass eigenvalues after diagonalization, 17122 <^ ^33 ^ M, it 
is needed to realize the hierarchical determinants det4x4/ detsxs <^ mss. Then the 
resultant 4x4 textures which realize this hierarchical structure are found to be the 
followings for each case: 

• case 1 

There are two distinct types of texture, 
o type A 





2 


3 


4 


4 


2 


/ 





m 


\ 


3 





m 







4 


m 






M 


4 


lo 





M 


m / 



det 4x4 ~ m^m 



(3.15) 



'mm\ 



(3.16) 



o type B 





2 


3 


4 


4 


2 


/ 





m 


\ 


3 





m 







4 


m 




m 


M 


4 


[0 





M 


) 



det 



4x4 



(3.17) 



~ (radiatively induced). (3.18) 

Note that in these textures the 3rd generation is almost decoupled from the 
other ones. Contrastingly, these textures are of the same form as those of cases 
2 and 3 (( |3.11| ) and ( |3.13| )) which are used for the 2nd, 4th and 4th generations 



to obtain non-zero 77122- Therefore, these small eigenvalues 17122 are strongly 
affected by the existence of the 4th and 4th generations. 

case 2, 3 

We found that there is essentially no candidate in these cases. 
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One might think that the texture 
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3 


4 


4 
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(0 
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3 








m 
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m 


m 


m 


M 


4 


lo 





M 


/ 



det 



4x4 



(3.19) 



reproduces a non-zero eigenvalue radiatively. However, in this texture the 
second and third generations have the same structure. Therefore this matrix 
has at most rank 3 and yields an almost zero eigenvalue for 77122 even when all 
the radiatively induced Yukawa couphngs are included. 

There are two more candidates for texture having hierarchical mass structure: 
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/ m 
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m 
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lo 
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771 J 
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/ 771 
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3 








m 





4 




m 


771 
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4 


lo 





M 


/ 



det 



4x4 



(3.20) 



det 



4x4 



(3.21) 



However, ( p.20|) and (|3.21|) coincide with ( p.l5|) and (|3.17| ) by changing the 
label of the generation (2^3). We do not consider these types of texture.^ 



In conclusion, we have two candidates, ( |3.15|) and (|3.17|) , which may reproduce 
hierarchical mass structure between the second and third generations of the up and 
down sectors. 

In addition to the difference between the mass eigenvalues for types A and B, 
another remarkable difference exists between these two types of texture. As we have 
already mentioned, it is the infrared behavior of Yukawa couplings that is character- 
istic to this ANF model. As long as we restrict ourselves to the third generation, two 
textures have the same infrared structures (Figs. |l]and the Yukawa couplings I33 

* Strictly speaking, we cannot exchange the generation label (2 ^ 3) when we use one of the 



textures ( 3.15 ) and ( 3.17 ) for the up-quark sector and one of ( 3.20 ) and ( 3.21 ) for the down-quark, 
and vice versa, for example. This case yields a large mixing angle between generations, which is 
experimentally excluded. 
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sit almost on their infrared fixed points at low energy in both cases. However, the 
infrared behavior of the eigenvalues of the second generation is quite different. For 
the type A texture, the resultant eigenvalue (see ( |3.16| )) is obtained from the 
tree-level Yukawa couplings (and VEVs whose orders are assumed), and therefore 
it can be regarded as an infrared fixed point value (Fig. ^). On the other hand, for 
the type B texture, the eigenvalue is induced radiatively by the renormalization 
procedure and does not reach its theoretical infrared fixed point value at low energy 
(Fig. I). 





Figure 1: Typical behavior of mss in 
the type A texture. 



Figure 2: Typical behavior of mss in 
the type B texture. 




Figure 3: Typical behavior of m22 in 
the type A texture. 

(In the above figures, we set Mqut = 7 x 10 
and all the non-zero Yukawa couplings at M 



Figure 4: Typical behavior of in 
the type B texture. 

GeV, acuT = 1-0, M = 1 TeV, tan/3 = 5, 
jT are taken to have the same value Yi.) 



3.2 Texture for mass matrix 

Next, we argue which texture can be used for the quark and lepton sectors. From 
the above discussions we have learned that the type A texture provides us with a 
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mechanism in which we can make a full use of infrared fixed points. We see from 
figure I that the typical value of the hierarchical factor ^ (see (|3.16|) ) is generally 
1/100 or less, and that this factor becomes smaller for larger tan/3. It is far smaller 




Figure 5: Typical behavior of the hi- Figure 6: Typical behavior of the hi- 

erarchical factor in the type A tex- erarchical factor in the type B tex- 

ture (ttGUT = 1, M = 1 TeV). ture (tan/5 = 5, M = 1 TeV). 

than the observed strange to bottom mass ratio (~ 1/30). Therefore we do not use 
the type A texture but adopt the type B one for the down-quark and charged lepton 
sectors. On the other hand, the hierarchical factor in the up-quark sector, charm to 
top mass ratio (~ 1/250), is much smaller than the ratio of bottom and strange. We 
can adopt the type A mass texture for the up-quark sector. Note that in the type A 
texture, the masses of heavy quarks (charm as well as top) are given by the infrared 
fixed point values for Yukawa couplings, which are almost insensitive to their initial 
values at Mqut- 

Once we fix the texture for the up and down/lepton sectors, we can estimate the 
quark and lepton masses at low-energy scale. However, there arise two difficulties in 
reproducing hierarchical structures both in up and down sectors. First, the top and 
bottom Yukawa couplings reach their infrared fixed point values, which requires a 
large tan (3 scenario. This large tan (3 scenario makes the hierarchical factor in the 
up sector much smaller than the actual value of the ratio of top and charm (see Fig. 
1^). Second, the ratio of the eigenvalues, ^33/77122, at low energy is found to be at 
least 100 in the type B texture (Fig. ||). 

Some improvement must be made to overcome the above mismatches. It is 
found that we can remove both difficulties by introducing only one parameter, e, 
and attaching it to bottom/tau Yukawa couplings. Even when e is introduced, the 
type A texture cannot be used for the down/lepton sectors, because their non-zero 
134 elements contribute to the beta-function of the top Yukawa coupling and make its 
infrared fixed point value far smaller than the experimental one. Then, we finally 
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find that the following mass texture for quark and lepton at the GUT scale can 
reproduce the low-energy experimental values of the fermion masses: 



mu 



rriD 



rriE 



2 

3 
4 
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2 
3 
4 
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2 
3 
4 
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2 
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3em 
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M 
4 
m 

m 
M 



4 

3m 

3m 
M 



4 
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M 
rh j 

4 

\ 


M 

; 

4 

\ 


M 



(3.22) 



(3.23) 



(3.24) 



} 



Here we have used the Higgs field of the 126 (45) representation of SO{\SS) {SU{5)) 
so that the boundary conditions in the down/lepton sector may correctly reproduce 
the observed bottom/tau (and strange/mu) ratio, as noted in the previous section. 
In this texture, all the quark Yukawa couplings except for l^dgg converge to their in- 
frared fixed points independently of their initial values at the GUT scale. Within this 
approximation, this texture leads to the low-energy prediction of fermion masses:[|] 



nit ~ 
nib ~ 
nir ~ 

for the input values 
Mgut ~ 

-^SUSY ~ 



180 GeV, 
3.1 GeV, 
1.75 GeV, 



nic 
nis 
m,, 



1.0 GeV, 
0.081 GeV, 
0.103 GeV, 



(at Mz 



(3.25) 



5.3 X 10^6 Qgv, 
1 TeV, 



e ~ 
V - 



0.2, 
3 TeV. 



(3.26) 



C^GUT ~ 0.3 
tan p ~ 20 , 

These results are surely in good agreement with the present experimental values. 
For the above input values, both Mqut and ogut are larger than those of the usual 
MSSM because of the asymptotically non-free character of this ESSM. It is also 
noted that e is on the order of the Cabibbo angle. This fact may be naturally repro- 
duced with the anomalous U{1) symmetry [|l^], which may be helpful in considering 
hierarchies between the first and other generations. 



^For simplicity, we set the blanks in mu (3.22) to be zeros. 
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3.3 CKM mixing angles 



Encouraged by the successful predictions of the texture in the previous section, we 
finally consider full mass matrices including quark mixing angles. This may be 
done by introducing hierarchically very small Yukawa couplings. As for these very 
small couplings, we cannot apply the IRFP approach to texture forms in a similar 
way to the previous section. However, by considering the extension of the above 
uniquely obtained texture, we can almost fix the Yukawa interactions between all 
five generations phenomenologically. 

As noted in section 2, the 1-3 quark mixing is described well by the 1-3 mixing 
in the up sector and the 1-2 quark mixing by the 1-2 mixing in the down sector. 
Therefore the eigenvalue mn for up- (down-) quark sector can be automatically 
reproduced by introducing a small mixing Yu^^^ (^^12) i^i^o our texture. A problem 
arises in the 2-3 quark mixing for which the usual seesaw-type relation between 
mixing angle and eigenvalues is not successful. Fortunately, however, in our extended 
model, the mass eigenvalues for the second generation can be properly reproduced by 
mixing with the extra vector-like generations. Therefore the 2-3 mixing parameter 
can be treated independently of the 2-2 mass eigenvalue as long as it does not affect 
very strongly. We can thus adopt the following 3x3 matrices for the ordinary 
generations in which the CKM mixing angles may correctly reproduced. 



12 3 



3x3 



(mz))3x3 



1 / 

2 

3 V 

1 / 

2 ( 

3 V 



6' \ 



■ m 



(3.27) 



1 

2 3 

e" 1 J 



nib. 



(3.28) 



The down-quark (and charged lepton) sector is just the Fritzsch type of texture 



21], in which the mass of the second generation induced by the seesaw mechanism 



is much smaller than "tree- level" one (see (p.6|) ) , which now comes from mixing with 
the extra generations. At this point, note that e in the texture in the previous section 
happens to have just the same value as the Cabibbo mixing angle for explaining all 
hierarchies in the second and third generations of quarks and leptons. Therefore it 
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is not necessary to introduce any small mixing parameter other than e. 



m 




Vus 
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\Vcb\ I 


\Vub\ 


rriu 


2 
3 
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0.6 1 
0.27 2 
0.06 3 


0.17 3 
0.035 4 
0.007 5 


0.008 
0.002 
0.0003 


~ 32 MeV 
~ 1.3 MeV 
~ 0.5 MeV 



(3.29) 
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(3.30) 



After all, there is a reasonable 5x5 GUT-scale texture which explains the experi- 
mental values of the CKM mixing angles, and we can see that this texture is actually 
almost the only possibility left in this situation. 
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This texture reproduces the low-energy predictions at Mz scale: 



mc 
mt 



2.9 MeV, 
1.0 GeV, 
180 GeV, 



md ~ 
mfe ~ 



4.3 MeV, 
0.089 GeV, 
3.1 GeV, 



m^ ~ 



m^ 



0.6 MeV, 
0.104 GeV, 
1.75 GeV, 



(3.31) 



(3.32) 



(3.33) 



(3.34) 
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IK 



CKMl 



/ 0.974 
0.228 
V 0.005 



0.228 
0.973 
0.039 



0.0037^ 
0.039 
0.999 



(3.35) 



These values are also nearly consistent with the experimental ones.0 



4 Summary and discussion 

We have investigated the fermion mass matrix structure at the GUT scale in an 
asymptotically non-free model with a pair of extra generations. The characteristic 
feature of this model is that the couplings converge to their infrared fixed points 
very quickly. By making full use of the IR behavior of the couplings, we determined 
the fermion mass matrices at the GUT scale almost uniquely. We have found the 
following: i) We can understand the charm quark mass as well as the top in terms of 
their infrared fixed point values. It is interesting that the hierarchical factor of the 
top and charm ratio comes from the existence of the 4th and 4th generations at the 
TeV scale. Also we should like to note that the Yukawa couplings of 1^24(^42) reach 
their infrared fixed points with considerable strength. This indicates that the second 
generation is strongly coupled with the extra generations, ii) Though the masses 
of the other lighter quarks are not related to the infrared structure for the ANF 
character, we can determine their mass texture almost uniquely by introducing only 
one small parameter. It is interesting that this small parameter happens to be equal 
to the Cabibbo mixing angle. In the down-quark sector the resultant strange-quark 
mass eigenvalue is suppressed by the existence of the extra generations, as in the up- 
quark sector, in spite of the appreciable large induced Yukawa coupling ¥22- iii) As 
for the lepton masses, they are reproduced quite successfully by assuming that the 
relevant Higgs fields belong to 126 representation of 50(10). This is in remarkable 
contrast to the case of the MSSM in which, as seen from the Georgi-Jarlskog type 



of texture p2|, one has to assume that the relevant Higgs field must be the mixture 
of 10 and 126 representations. 

In the MSSM case, there are many works containing phenomenological analyses 
on the fermion mass structure. It is known that, for example, the Fritzsch- and 
Georgi- Jarlskog-type textures provide us with important hints and standard basis for 
finding realistic models. Until now, in the ESSM, we have not established a standard 
texture which reproduces the phenomenological fermion masses well, and the aim of 
this paper is to establish the form of the possible texture in this model. Then, we 
would also like to emphasize the importance of the IRFP structure. We think that. 



•l-This VcKM is extracted from the original (unitary) 5x5 CKM matrix, and the other matrix 
elements are suppressed by large M. The unitarity of Vckm is realized up to 10^^ for M ~ O(TeV). 
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particularly in asymptotically non-free theories, the infrared fixed point approach 
can be one of the attractive selection rule for the texture form, as well as the other 
methods, e.g. horizontal symmetry. We could surely assign some quantum numbers 
of U{1) symmetry [|16] to each fermion and relevant Higgs particle to reproduce our 
texture (including e parameter), but our aim here is to establish the possible form 
of texture first. 

It is essential for us to understand the heavier fermion masses as their IR fixed 
point values that not only the SUSY breaking scale but also the invariant masses of 
the extra generations are on the order of the TeV scale. This fact implies that when 
SUSY is discovered, the extra generations may be also found. Using muon colliders 



23] in particular, the extra generations may be explored easily, since in our model 



the second generation couples strongly to the extra generations. 
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Appendix A More complex cases 

In this appendix, we briefly present analyses for two more complex cases. In one 
case, more than two generations couple to the 4th generation via invariant mass 
terms and in the other case the form of the texture is non-symmetric. 

1 More than two M 

Let us make the classification of hierarchical textures, following the analysis in sec- 
tion 3. First, we consider 3x3 texture. In addition to the three cases discussed 
in section 3 ( (|3.9| ), (|3.13|) ), there are two types of texture which provide a 

non-zero eigenvalue mss : 

• case 4 
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• case 5 
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Prom the above two textures, we get three types of texture which produce the 
hierarchical mass eigenvalues <^ iris^ <S M, M' at low energy without a small 
parameter e, in addition to the type A and B textures obtained in section 3. 
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Next we consider a realistic mass texture of for quarks and leptons. One can 
easily see that all the above types of textures have hierarchical factors of order 1/100 
or less and no IRFP structure for the 2nd generation, unlike the type A texture. 
Therefore we must also introduce a (small) parameter e to obtain the hierarchy in 
the down-quark and/or lepton sector. On the other hand, we can get the hierarchy 
in the up-quark sector from any one of five textures (type A-E). As mentioned in 
section 3, we adopt the type A texture for the up-quark sector by making active use 
of the infrared fixed-point structure which is a characteristic feature of this ANF 
model. Note that due to the SO{10) GUT-like relations for Yukawa couplings to a 
singlet Higgs, if we adopt the textures of type C-E for the down and lepton sectors 
we have to add M' to the up-quark texture (the type A texture). These quantities 
M' change the determinant and thus spoil the hierarchical structure of the type A 
texture. Therefore we also must include the small parameter e in the invariant mass 
term M'. Taking into account all issues discussed to this point, we searched the 
reahstic textures of quark and lepton at the GUT scale and found no candidate to 
reproduce the present experimental data of hierarchical mass eigenvalues, except for 
the one obtained in section 3. 



2 Non-symmetric texture 

Until this point, we have implicitly taken the textures to be of symmetric forms. An- 
other more general analysis is to consider non-symmetric types of texture. However, 
the general analysis is too complex and is not particularly physically meaningful. 
Therefore we suppose the up-type texture to be of the type A. We made numerical 
analyses of the types of 4 x 4 texture for the down-quark and charged lepton sectors 
which reproduce the hierarchical mass ratios charm/top, strange/bottom, mu/tau, 
etc., without the small parameter e. Even in this situation, we found no realistic 
candidate, except for the one obtained in section 3. 



Appendix B The renormalization-group equations 



We present the 2-loop beta-functions for gauge couplings of SU{3)c x SU{2)w x 
U{1)y and the 1-loop beta-functions for Yukawa couplings. Here we neglect the CP 
phase, which does not affect the numerical results. The evolution of gauge couphng 
constants is given by 



dgj 
dt 
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9t 



IGtt^ (IGtt 



2^2 



j a=u,d,e 



-E E d^xYl 

k=l X=Q,u,d,L,e 



(B.l) 
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where bi = (10.6, 5, 1) for U{1)y (in a GUT normahzation), SU{2)w and SU{3)c 
respectively, and 
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The beta-functions for Yukawa couplings in the superpotential (3^) are given as 
follows: 
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TriSYlY^) + Yi + 6Yi + Yi + Y: (y^ + Y^) 
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